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6.1.1 Joint Distributions and Independence 


For three or more random variables, the joint PDF, joint PMF, and joint CDF are defined in a similar way to what we 
have already seen for the case of two random variables. Let X\, X2, • • •, X n be Tl discrete random variables. The 
joint PMF of Xi, X2, ■ ■ % X n is defined as 

Px 1 ,X 2 ,...,X n ( x li X2, • • • ,x n ) = P(x 1 = Xi, X 2 = X21 • • • ,X n = x n ). 

For Tl jointly continuous random variables X\, X2, • • •, X n , the joint PDF is defined to be the function 
fx 1 X 2 ...X n (*1) x 2 , • • • , Xn) such that the probability of any set A C R. n is given by the integral of the PDF over 
the set A. In particular, for a set A £ M n , we can write 

fx i-XV ■ -X n {x\i X21 1 x n )dx\dx 2 • ■ ■ dx n . 

A 

The marginal PDF of Xi can be obtained by integrating all other Xj's. For example, 

/ oo p 00 

■ fx 1 X 2 ...X n (xi,X 2 , ■ ■ ■ ,X n )dX 2 • ■ -dx n . 

00 J — 00 

The joint CDF of Tl random variables Xi, X2 ,...Xn is defined as 

Fx u x 2 ,...,x n ( x i,x 2 ,...,x n ) = P(X 1 < x u X 2 <x 2 ,...,X n < x n ). 



Example 6.1 

Let X, Y and Z be three jointly continuous random variables with joint PDF 


fxYZ (x, y, z) 


c(x + 2 y + 3 z) 0 < x, y, z < 1 
0 otherwise 


1. Find the constant C. 

2. Find the marginal PDF of X. 

• Solution 

o 1. 


/ oo n 00 n 00 

/ / fxYZ (x, y, z)dxdydz 

-OO J —00 J —00 


-00 J —00 J —00 

*1 pi pi 


= If! 

-n 

= l c (t +3zl dz 

= 3c. 


c(x + 2 y + 3 z) dxdydz 


c { - + 2y + 3z ) dydz 

Li 
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Thus, C = — . 


2. To find the marginal PDF of X , we note that i?x = [0, 1] . For 0 < X < 1 , 


we can write 


n oo 

■ 

i 


Thus, 


/x(«) = 


fxYz(x,y, z)dydz 


x + 2y + 3 z) dydz 


1 1 

— (x + 1 + 3 z) dz 

O 


1 ( 5 

= —( x + - 


/x(«) = 


f(z+f) 0 < a; < 1 

0 otherwise 


Independence: The idea of independence is exactly the same as what we have seen before. We restate it here in terms of 
the joint PMF, joint PDF, and joint CDF. Random variables X\, X 2 , • • •, X n are independent, if for all 

(x 1 ,x 2 , ...,x n ) G M n , 

F Xl ,X 2 ,...,X n ( x 1 ) x 2, • • • > x n) = F Xi ( x l)Fx 2 (x 2 ) ■ ■ ■ F Xn (Xn). 

Equivalently, if X\, X 2 , ..., X n are discrete, then they are independent if for all (xi, X 2 , . . . , X n ) G M n , we have 
P Xl ,X 2 ,...,X n (x 1 , * 2 , • • • ,*n) = P Xl (xi)P X2 (x 2 ) ■ ■ ■ P Xn (x n ). 

If -X"i, X2,..., X n are continuous, then they are independent if for all (x\, X 2 ,. . . , X n ) G M n , we have 
f Xl ,X 2 ,...,X n (x 1 , 32 , ...,X n ) = f Xl (xi)fx 2 (x 2 ) ■ ■ ■ fx n (x n ). 

If random variables ^ 2 ^ •••> -X"n are independent, then we have 

£[X!X 2 • • ■ X n ] = £[X!]£[X 2 ] • • ■ E[X n }. 

In some situations we are dealing with random variables that are independent and are also identically distributed, i.e, 
they have the same CDFs. It is usually easier to deal with such random variables, since independence and being 
identically distributed often simplify the analysis. We will see examples of such analyses shortly. 

Definition 6.1. Random variables X\, X 2 ,X n are said to be independent and identically distributed (i.i.d.) if they 
are independent, and they have the same marginal distributions'. 

F Xl {x) = Fx 2 (x ) =... = F Xn (x), for all x G M. 

For example, if random variables X\, X 2 ,..., X n are i.i.d., they will have the same means and variances, so we can 
write 
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E[X 1X2 ■ ■ ■ X n \ = E[Xi\E[X 2 \ ■ ■ ■ E[X n ] (because the X^s are indepenednt) 

= E[Xi]E[Xi] ■ ■ ■ E[X 1] (because the X^’s are identically distributed) 
= E[Xi] n . 

<— previous 
next —> 
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